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Overview  of  Research 


In  1991  we  submitted  a  proposal  entitled  “Matched  Subspace  Filtering  for  Detection,  Estimation,  and 
Time  Series  Analysis.”  In  it  we  proposed  to  study  four  problems: 

1.  Estimation  of  the  Frequency- Wavenumber  Spectrum; 

2.  Matched  Subspace  Filters  for  Matched  Field  Processing; 

3.  Maximum  Likelihood  Identification  of  Modes  from  Space-Time  Data;  and 

4.  Statistical  Inference  Within  the  Wavelet  Representation. 

With  ONR  support  under  contract  N00014-89-J-1070,  we  studied  these  problems.  Let’s  review  our  findings. 

1.  In  references  [CSM91]  and  [C1S92],  we  generalized  the  results  of  [MuS91]  to  characterize  the  class  of 
quadratic  estimators  of  the  frequency-wavenumber  spectrum  that  are  required  to  be  non-negative  and 
invariant  to  temporal  and  spatial  modulation.  These  estimators  take  the  form 

S(k,  0-  y)  =  y*D*(«,  -d)V*VD(x,  -0)y, 

where  n  is  wavenumber,  9  is  frequency,  the  vector  y  is  a  lexicographically-ordered  version  of  space- 
time  data,  D  is  a  Kronecker  product  of  modulator  matrices  for  time  and  space,  and  V  is  a  matrix  of 
space-time  windows  [CSM91],  [C1S92].  The  mean-squared  error  for  this  quadratic  estimator  is  bounded 
by 

mse(M)  >  (s(k’0))2> 

where  M  is  the  number  of  windows  used  to  construct  the  estimator.  This  bound  for  mean-squared  error 
actually  obscures  the  selectivity  and  the  variance  of  the  estimator.  Generally,  we  wish  to  resolve  a  cell  of 
frequency-wavenumber  space  in  order  to  concentrate  energy,  but  the  more  we  concentrate  it  the  higher 
is  the  variance  of  the  concentration.  So,  the  problem  is  to  choose  a  number  of  windows  equal  to  the 
time-bandwidth  product  for  the  data  and  the  cell  to  be  resolved.  The  selection  of  separable  space-time 
windows  is  discussed  at  length  in  [C1S92]  and  [Cla92].  More  generally,  the  designer  of  an  estimator 
that  resolves  energy  or  power  into  frequency-wavenumber  cells  can  design  a  multiplicity  of  orthogonal 
windows  which  have  quite  general  spectral  shapes  in  frequency  and  wavenumber. 

2.  In  references  [ScF94]  and  [BeS94],  we  have  generalized  what  was  previously  known  about  detection 
and  estimation  of  rank-one  signals  to  the  detection  and  estimation  of  rank-r  signals  obscured  by  rank-< 
interferences.  This  work  produces  linear  and  quadratic  forms  in  oblique  projections.  These  projections 
project  data  onto  one  subspace  along  the  direction  of  another.  The  singular  values  of  the  oblique 
projections  determine  the  performance  of  the  linear  and  quadratic  forms,  and  these  singular  values 
depend  on  the  geometrical  angles  between  the  subspaces.  With  these  results,  we  have  been  able  to  gain 
new  insights  into  the  resolution  of  closely  spaced  subspaces  (H)  and  (5)  and  into  the  detection  of  signals 
that  lie  in  a  subspace  (H)  that  is  near  to  an  interfering  subspace  (5).  As  an  example  of  what  our  results 
have  produced,  we  list  here  the  signal- to- noise  ratio  (SNR)  in  an  optimum  subspace  detector  and  the 
gain  against  noise  ( G )  when  resolving  two  closely  spaced  subspaces: 

.,2 

SNR  =  ^0'H*P£H0 
a2  ~  15  “ 


G  =  tr  [H'Pg  H]-1 
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=  E 
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sin2  $i 


Pg  :  projection  onto  (S)± . 

These  formulas  illustrate  that  the  angles  6 ;  between  the  signal  subspace  {//)  and  interference  subspace 
( S )  determine  performance.  In  our  work  on  the  geometry  of  the  Cramer-Rao  bound  [ScM93],  we  have 
shown  that  the  variance  for  resolving  the  subspace  components  of  a  signal  is  bounded  as 
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where  now  H  and  S  are  sensitivity  matrices  that  describe  how  parameter  variations  influence  the  mea¬ 
sured  data.  In  summary,  performance  bounds,  noise  gains,  and  signal-to-noise  ratio  gains  all  depend 
on 


tr  [H’Pg  H]-1 


M 


where  Oi  are  principal  angles  between  subspaces.  When  these  angles  are  small,  parameter  estimation 
variance  is  high,  noise  gain  is  high,  and  signal-to-noise  ratio  is  low.  These  findings  clarify,  for  example, 
the  difficulty  of  solving  matched  field  processing  problems  when  medium  parameters  produce  normal 
mode  subspaces  which  are  nearly  collinear.  We  consider  our  results  on  these  problems  to  be  essentially 
complete,  except  for  their  extensions  to  Hilbert  spaces  and  to  special  subspaces  such  as  subbands  of 
wavelet  decompositions. 


3.  In  references  [Cla92]  and  [C1S94],  we  have  derived  maximum  likelihood  estimators  for  the  parameters 
of  two-dimensional  damped  harmonic  signals  that  are  sensed  by  a  two-dimensional  array.  The  results 
apply  to  the  processing  of  data  in  linear  arrays  that  extend  over  space  and  take  data  over  time.  The 
likelihood  maximization  for  this  problem  was  actually  achieved  by  minimizing  residual  error  in  the 
orthogonal  subspace  of  the  2-D  signals,  using  a  new  characterization  of  this  subspace  and  a  computing 
algorithm  that  uses  a  prediction  polynomial  in  one  dimension  and  a  Lagrange  interpolating  polynomial 
for  interpolating  between  the  two  dimensions.  The  algorithm  minimizes  the  quadratic  form 


tr  [(Y  —  FS)*R-1(Y  —  FS)] , 

where  Y  is  the  array  data,  ( F )  is  a  candidate  2-D  subspace,  S  is  a  candidate  set  of  mode  parameters, 
and  R-1  is  the  broadband  covariance  matrix.  In  [C1S94],  the  authors  derive  Cramer-Rao  bounds  for 
2-D  deterministic  modal  analysis.  We  consider  this  work  to  be  complete. 

4.  In  reference  [Spu94],  Spurbeck  has  established  the  connection  between  algebraic  resolutions  of  identity 
and  subband  decompositions  of  l?.  He  has  constructed  oblique  projections  onto  arbitrary  subsampled 
subspaces  along  nearby  subsampled  subspaces.  These  projections  generalize  the  usual  projections  asso¬ 
ciated  with  QMF  filters  and  suggest  that  one  can  build  oblique  projections  for  resolving  nonorthogonal 
subsampled  time  series  that  might  arise  in  multiuser  communication.  He  has  also  shown  what  hap¬ 
pens  to  the  second-order  properties  of  wide-sense  stationary  sequences  that  propagate  through  subband 
decompositions  which  do  not  have  the  perfect  reconstruction  property:  they  become  periodically  cor¬ 
related.  In  references  [SpS92]  and  [SpS94],  the  authors  have  imbedded  scalar  periodically  correlated 
time  series  in  vector  WSS  time  series  and  constructed  least-squares  filters  for  equalizing  and  estimating 
periodically  correlated  time  series.  These  results  illustrate  that  filterbanks  or  subband  decompositions 
are  very  natural  structures  for  filtering  periodically  correlated  time  series.  We  are  continuing  to  develop 
a  toolkit  for  filtering  periodically  correlated  time  series  by  filtering  the  corresponding  (internal)  vector 
WSS  time  series. 
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L.  L.  Scharf  and  L.  T.  McWhorter,  ’’Geometry  of  the  Cramer-Rao  Bound,”  Signal  Processing  31:3,  pp. 
1-11  (April  1993). 

M.  P.  Clark  and  L.  L.  Scharf,  “On  the  Complexity  of  1QML  Algorithms,”  IEEE  Trans  Signal  Proc  40, 
pp.  1811-1813  (July  1992). 

L.  L.  Scharf,  “The  SVD  and  Reduced-Rank  Signal  Processing,”  Signal  Processing  24,  pp.  111-130 


(November  1991). 


B.  Derras  and  C.  T.  Mullis,  "A  Unified  Approach  to  System  Approximation."  AMSP  lonrn  23:1, 29-48 
(1991). 

W.  P.  Burleson  and  L.  L.  Scharf,  “A  VLSI  Design  Methodology  for  Distributed  Arithmetic."  Joum 
VLSI  Signal  Proc  2,  pp.  235-252  (1991). 

c.  Books  (and  sections  thereof)  submitted  for  publication: 

None. 

d.  Books  (and  sections  thereof)  published: 

C.  T.  Mullis  and  L.  L.  Scharf,  “Quadratic  Estimators  of  the  Power  Spectrum,”  Chapter  One  in  Advances 
in  Spectrum  Analysis  (Prentice-Hall,  1991). 

C.  T.  Mullis,  Digital  Signal  Processing,  Second  Edition,  (Englewood  Cliffs,  NJ:  Prentice  Hall,  1991). 

e.  Technical  reports  and  nonrefereed  papers: 

M.  L.  Vis  and  L.  L.  Scharf,  “CR  Bounds  for  System  Identification  and  Modal  Analysis  in  Colored  Noise," 
ECE  Technical  Report  DSP-513  (June  1994). 

L.  T.  McWhorter  and  L.  L.  Scharf,  “Quadratic  Estimators  of  Covariance,”  ECE  Technical  Report  DSP- 
512  (December  1993). 

L.  T.  McWhorter  and  L.  L.  Scharf,  “Geometry  of  the  Cramer-Rao  Bound,”  ECE  Technical  Report 
DSP-505  (December  1991). 

f.  Patents  filed: 

None  (one  in  preparation,  disclosure  filed  12/93). 

g.  Patents  granted: 

None. 

h.  Invited  presentations  at  topical  or  scientific/technical  society  conferences: 

L.  L  Scharf,  “Geometrical  Ideas  in  Detection,  Estimation,  and  Time  Series  Analysis.”  Proc  7th  SP 
Workshop  on  Statistical  Signal  and  Array  Processing,  Quebec  City  (June  1994). 

L.  L.  Scharf  and  B.  Friedlander,  “Matched  Subspace  Detectors,”  1993  Workshop  on  Underwater  Acoustic 
Signal  Processing,  Kingston,  RI  (September  1993). 

L.  L.  Scharf,  “Keynote  Speech,”  1991  IEEE  Workshop  on  Underwater  Acoustic  Signal  Processing, 
Kingston,  RI  (October  1991). 

i.  Contributed  presentations  at  topical  or  scientific/technical  society  conferences: 

M.  Spurbeck  and  L.  L.  Scharf,  “Least  Squares  Filter  Bank  Design,”  Proc  28th  Annual  Astlomar  Conf 
on  Signals,  Systems,  and  Computers,  Asilomar,  CA  (November  1994). 

L.  T.  McWhorter  and  L.  L.  Scharf,  “Exact  Maximum  Likelihood  Estimation  of  Autoregressive  Time 
Series,”  Proc  28th  Annual  Asilomar  Conf  on  Signals,  Systems,  and  Computers,  Asilomar,  CA  (November 
1994). 

L.  T.  McWhorter  and  L.  L.  Scharf,  “Muitiwindow  Estimators  of  Correlation,”  Proc  28th  Annual  Asilo¬ 
mar  Conf  on  Stgnals,  Systems,  and  Computers,  Asilomar,  CA  (November  1994). 


L.  L.  Scharf  and  L.  T.  McWhorter,  "Quadratic  Estimators  of  Correlation,"  Proc  7th  IEEE  Workshop 
on  SSaP,  Quebec  (July  1994). 

M.  Spurbeck  and  L.  L,  Scharf,  "Least  Squares  Filter  Design  for  Periodically  Correlated  Time  Series," 
Proc  7th  IEEE  Workshop  on  SSAP ,  Quebec  (July  1994). 

L.  T.  McWhorter  and  L.  L.  Scharf,  "Quadratic  Performance  Bounds  for  Parametric  Estimators."  Proc 
27th  Annual  A silomar  Conf  on  Signals.  Systems,  and  Computers ,  Asilomar,  CA  (November  1993) 

L.  L.  Scharf  and  B,  Friedlander,  “Matched  Subspace  Detectors,”  Proc  27th  Annual  Asilomar  Conf  on 
Signals,  Systems,  and  Computers,  Asilomar,  CA  (November  1993). 

J.  Thomas,  L.  L.  Scharf,  and  D.  W.  Tufts,  “Probability  of  a  Subspace  Swap,”  Proc  27th  Annual  Asilomar 
Conf  on  Signals,  Systems,  and  Computers,  Asilomar,  CA  (November  1993). 

M.  Spurbeck  and  L.  L.  Scharf,  “Causal  Wiener  Filtering  of  Periodically  Correlated  Sequences,"  Proc 
SIAM  Conf  on  Linear  Algebra,  Signal  Systems,  and  Controls,  Seattle  (August  1993). 

L.  T.  McWhorter  and  L.  L.  Scharf,  “Variance  Bounds  for  Modal  Analysis,”  Prcc  SIAM  Conf  on  Linear 
Algebra,  Signal  Systems,  and  Controls,  Seattle  (August  1993). 

M.  P.  Clark  and  L.  L.  Scharf,  “Frequency- Wavenumber  Spectrum  Analysis,"  Proc  1992  Workshop  on 
Statistical  and  Array  Processing,  Victoria,  BC  (October  1992). 

L.  L.  Scharf  and  T.  McWhorter,  “Geometry  of  the  Cramer-Rao  Bound,”  Proc  1992  Workshop  on 
Statistical  and  Array  Processing,  Victoria,  BC  (October  1992). 

M.  P.  Clark  and  L.  L.  Scharf,  “Efficient  Frequency- Wavenumber  Spectrum  Estimation  using  Sliding 
Time-Division  Windows,”  Proc  1992  Asilomar  Conf  on  Signals,  Systems,  and  Computers,  Pacific  Grove, 
CA  (November  1992). 

T.  McWhorter  arm  L.  L.  Scuarf,  “Cramer-Rao  Bounds  lor  Deterministic  Modal  Analysis,"  Proc  1991 
Asilomar  Conference  on  Signals,  Systems,  and  Computers,  Pacific  Grove,  CA  (November  1991). 

M.  P.  Clark  and  L.  L.  Scharf,  “Exact  Maximum- Likelihood  DOA  Estimation  Using  Generalized  IQML." 
Proc  1991  Asilomar  Conference  on  Signals,  Systems,  and  Computers,  Pacific  Grove,  CA  (November 
1991) 

C.  Fajre  and  C.  T.  Mullis,  “The  L°°  Wiener  Problem:  An  Application  of  the  L00  Extension  Problem,” 
EUSIPCO  92  Conference,  Brussels,  Belgium  (August  1992). 

j.  Honors/awards/prizes: 

C.  T.  Mullis  promoted  to  full  Professor  effective  January  1.  1993. 

L.  L.  Scharf  appointed  National  Distinguished  Lecturer  for  IEEE  Society  for  Signal  Processing  ( 1 993— 

1994). 

k.  Graduate  students  and  post-doctorals  supported  under  the  contract  for  the  three  years 
ending  1  October  1993:  (no  female/minority) 

Knut  Aas 

Richard  T.  Behrens 
Michael  P.  Clark 
Mark  Spurbeck 
John  K.  Thomas 
Fred  Ziel 


1.  Graduate  Theses  Submitted: 


K.  Aas.  "Analysis  and  Synthesis  of  Filter  Banks  for  Wavelet  Decompositions  and  Subhand  Coding." 
Ph.D.  Dissertation.  University  of  Colorado  at  Boulder  (May  1993). 

M.  P.  Clark,  “Estimation  Techniques  for  Sensor  Array  Processing."  Ph  D.  Dissertation.  University  of 
Colorado  at  Boulder  (May  1992). 

M.  Spurheck,  “Filter  Bank  Analysis  and  Design."  Ph.D.  Dissertation.  University  of  Colorado  at  Boulder 
(December  1994). 

F.  Ziel,  “MIMO  Filters  with  Redundancy:  Connections  with  Channel  Coding  and  Frames."  PhD 
Dissertation,  University  of  Colorado  at  Boulder  (May  1995). 

m.  Work  in  Progress: 

F.  Ziel  and  C.  T.  Mullis,  “Discrete  Wavelet  Frames  and  Filter  Banks."  to  be  submitted  to  IEEE  Trans 
Signal  Proc. 

J.  K.  Thomas,  “Automatic  Bandwidth  Estimation  in  Spectral  Anaivsis,"  to  be  submitted. 

M.  Spurbeck,  “Wavelet  Decompositions  of  P ,"  to  be  submitted. 

L.  L.  Scharf  and  M.  Vis,  “Signal  Subspace  MUSIC  Algorithm,”  to  be  submitted 
J.  K.  Thomas,  “Nonstationary  Spectrum  Analysis,"  to  be  submitted. 

C.  T.  Mullis,  Text  on  “Advanced  Linear  Systems,"  to  be  submitted. 


